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PVS 



^ssenta^js a new analysis mode! caiied Auditory Percsptuai Putee Anaiysis CARPAL 
?if Ji!^^ ^^'^^^^ mixed maihemalical and pf.^^^^ 

.h.l seem correspond very much to how the human ear percelvi sound Tt'e 
^K'^ ^'^^f'' '^^'"^^^^ behaviour of t^nslanUespcns^o^S^^. 
; ne .esponse reacts sn pracuse as a pulse and the pufss Is analysed in -ud^'-'v 

"if ''"^^ nuetua ions - rippies - seems very important for the sound 
^Z? ? '^""^^"^^ ^ ^^^-'^-^ ^^^^^'^^ the r?pDtes ar^ often 

"^'J" ^^^" '^^^"s^-V- '^-^^ch affecte the pencd time of the rippfes 
"^^^ f'J^^'^ ^P^^^- Therefore the ripple pSod 
d..a.>se.j d.i^ctiy. ; he ear seems to have avo freauency ranqes wb'^re the T\m\^ 
tme iS ar^slyssd differentiy: A low ranpe up to 800-1000 4 wSre he S-^te^'^^et 

r—ffr '' ^^^,?Sh range hfgh vowels identified. The deep vowels have a" 
Z^t ^^^"^ '"l '^"^^ -^^^ ^^^"^'^^^ fluctuation of the dyna.oiic 

energy or the output of the auditory channels. Exampies of tiigh as weil as de2 

SS'ing vSvel? ■ ' ^ ^'^^ APPA is vary noila InsenltiS ' 



2® f 5^.^^^"'^°^' percepUon has been assumed to be short time 

S SntSTSv^f- -"^"^ '""^ because the construction of the 
^nSnHiSht ^^^'f- ' assumption has however caused several 

.-v,.r psrc;;..ves vow&ls ana in general how it percei^'es sound "pictures". 

^^j^if"^ dsveioped as a warning system that t^.ad to ^mrn aaainst 
SSL ®^ ^""^ '^^^^''^ ^P^^^'V sound from^breakino 

^Aigs that gr^s you a warning. Such a sound is a pulse and it cav have avan/short 
duf^bon. which Is not expedient in relafen to a Fourier trSfiS^^ iciS 

Fourier transformation is a mathematical tool that effmlnates the time d^mensio^ and 
ss merefore by nature not suitable for puise anai^'sis. The fact tha puises ve^ 
^'nportant the dynamic behavioiir of the signal Is ver^^ importar^t S^d the^eS 
anjiysis must be based on tools that reflA the physical ooSct of 4 Sea 



Pulse Analysss 



A puise is created by an abrupt force hiding a system. It might be a fault on a aear 
wtiQe! in a gearbox, and each time tiie fault on the whset is messed a pulse h 
generated by the force caused by the fault. Or it could be the pressure explosion 
cr«atgd by the vocal cords at a voiced phoneme in speech. That the force Is an 
abaipt force means that the transient response of tt)8 system is V8f>' importarft. 

The fuii Informatjon tiold in the pulse is given through the duratiorj of the puiss If we 
have a rectangular poise we have the foiiowing Fourier Transfofm: 



«0 Otherwise 



The Fourier integral car> be divided into three terms, where only one term contributes 
to the Fourier trarisfofm, and ft (s the integral through the duratfon of the pulse. In 
other words integration through longer time than the duraSon of the puise does not 
add anything to the spectmm of the pufss. This is In tact a piain reflection, but it is 
ratha' important. 



Fig. 1. A pulse train consisting of rectangular pulses. 



h we nave a puise \r$m as shown in fig. 1 and tiie Fourisr integrai is ionger than the 
Qurauon of the pulses but shorter than the period betwesn the pulses the spectrvim 
mil m a continuous spectrum, and the full informaOcn of the spectrum of the puise 
Will be present, if ihe Integratio.i ilrvie Is longer and contains a sufficient number of 
puises the spectwvn will be discrete and contain the harmonics of the fundament?'! 
frequsncy. The envelope of the spectrum is equal to the continuous spectrum of a 
singie pulse and the frequency step is equal to the reciprocal lime period between 
the puisss. 3y integrating through io.nger time we gain Information about the time 
period between the puises, but we lose information about the spectrum of the 
indfyiduai pulse because we only have information about the hannonics and not the 
tu>i spectfum. By pulse analysts the period bet.vesn the ouises can be determirred 
sinnpfy by measuring the tims between tine puises. 
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The physica; interpretation of signs! that is a puise tJBsn is that the individual pulse 
an expressfon of an occyrrence and tbe perbd between the pulses is therefore an 
sxpressson the time between the occurrences. Sr, the case of fault on a gear wheei in 
a gesrbox the spectrum of the individuai pulse describes crisracterislic of the fault 
arKi tie period between the pu.'sss describes the rotational spsed of the wheei. 
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Auditory Perceptual Pais© Anaiysis 



By a Fourier iranstorm the time domain is eliaiinated and trierefo'-;; a Fcurier 
traasforni is not opti^iai lor describing dynamic condition;; siaaaia. A Dettar method 
Is to divide the auditory frequency interval into a number ot audito' y c;-;annels by 
?r5sans os' a iiller bank of band-pass Mets, if the banc-pass flltsrs have Drosc; 
iraqiisncy bands they \m\\ have a shon impulse response and the time resoiutior^ is 
tiien high. 

\i has been assumed for mariy years that the coahiea of ear is divided into a 
number of auditory frequency channeis where the signai is analysed [Zwicker 1961], 
The ?r!sthods used v/ere however focused on quasi steady state ftequency analysis, 
among otiiers to be able to trace the formarsts In speech sigrisis. Another example is 
2wicker's Loudness mode! [Zwicker 1999], An exception, mich is described by F. 
Leonhard [leonharti 1993] and [Leonharti 2002], considers abrupt conges jo the 
energy, but a closer reiatlon to how the sound picture is perceived is not des<^bed, 

idealized a pulse Is an impulse response of a system and contains damped 
sigenfrequencies, which can be described by poles of the system, and (1 is in fact a 
i^ind of footprint of the system. The objective for a puise analysis Is to get as accurate 
and much information ouf. of ti-ie puise and It seems to be the case for auditorv 
perception. In the following the focus wi be put on analysing the "colour" of the 
sound picture or vowels, which can be consida'-ed as special "colours" of the sound. 



Fig. 2 shows SO msec of the vowei "s^:" as in "had" pronounced by a maie (the upper 
si0nsi) and a female (the lower signal). As it is seen the signals contains damped 
frequencies - most obvious for the male. It Is also clear that the Interval between the 
puises is about twice as long for the male compared to the femafe. 

To have a high time resolution the band-pass filters in the auditor^' channels have to 
have broad frequency bands, in fig, 3 10 msec of vowel "as:" spoiien by a male 
(about s.ne puise) and the output of 6 banci-oass filters sho^<vn. The pass-bands for 
the 6 filters are: 150-450. 300-9GG, 450-1350, 1400-2800, 2000-4000, and 2800- 
5600. The gain of the filters Is adjusted relatively to compensate for the frequency 
dependency sensitivity of the ear, and is set to 1, 1, 1. 3, 3, and 2. 





Fig. 2. 



50 msec of the vowel as in "had" 
pronounced by a ma! and a female. 
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h 3. 10 fnssc (one pulse) of ihe w>we) 'asr (fnafe) 
and output Jmm tf?e 6 band-pass ters. 



J. 4, 10 ffissc {hvo puises) of Sie vowef "se:" (fenisSg) 
snrf the oujput Sdjh the 6 band-pass fikars. 



rig. 4 shows 10 msec (about bvo puises) of the vowei pronounced by a female, 
and the output ftom the 6 band-pass niters. Compared to the vowel spoken by Oi© 
maie the period between ths pulses is only the haif - about 5 n-ssec for ths femais 
and ID msec for the male. However the periods of the l^uctuafion of the 4Sh and 5th 
band-paiss Hiter sre very simliar. In other words 8ie fliicluation is independent of the 
pitch period. 

On mat background there are \wo piienomena ihat are of Interest in the pulses. One 
is the nature of \h& fiuctaatson. The tarve period of ?ne hatf-wavs fiuctuations - dpoiss 
^ ssems to be very Important for ths sound picture. Tne other is the progress of the 
instantaneous energy through the duraHon of the pulse, it woulci be very t^Tipting to 
make a frequency analysis by rrjaans of Fourier transform to analyse the rippfeerbut 
the ripples are often composed of rrsc^e than one frequency, 'A-htcn affects the period 
lime of me tipples. One frequency rides on ths bad< of the ottier so to speak. 
Therefore s better method would be to rrseasure the Cms period of the ripple in a kind 
of rippie ar^aiysis. 



Ripple Analysis 

As it appears frotn fig. 3 the output iron) the Sixers is rather periodic. This could isad 
to ti-is assumptiof^. that fiuctuatlon only consists of one frequency. But band-pass 
filters are very broad baMed and the puise is a fansient response. This means lhat 
the ^uctuation often is formed by more than one frequency, in vowels It is typicaliy 
the secon<S formant that dominates but it is affected by one of the other fomiants. 



JMaaajla 



Fig. S. One puise from a speech signal and output 

from 6 band-pass filters that are rBciified, ^vhich 
is called the npple signaf. 
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To siiTipiif>' the snaiysis the output of the band-pass fsiters are half-wave rectified^ and 
these signals are called ripple signais. 

There is every irsdication that the ear is divided two areas were the riapie is analysed 
different In lower frequency range up to 1,000-1,500 Hz, it looks Hke'ths ripple is 
anaiysed by m^^suring the time from crossover to the top of the rippie or to the next 
OTSsover where the signa! goes zenj. Vowels detected by this method wiii be called 
deep vov/els. fn the frequerjcy range above 1,000-1.500 Hz the rlppfs is measured 
from the top of a ripple to the next. These voweis mil be caSed high vowisis. This Is 
anjwsy convenient in digitai signal processing because it Increase the resoiuibn 
about 4 times in the uppsr frequency range, ft is easier to measure the dppie if the 
output from the band-pass filters is half-wave rectifies. Fsg. 5 shovs^ the rectified 
signals of the vowel Tne corresponding signal in the ear vini! properly be silghtiy 
low-pass flltared.. but it is not done hers. 

The "colour" or vovvei is than analysed by measuring tf-se ripple for each auditor/ 
channel in a sufficient time frame and sort them in tirne bins each representing a 
predefined duration, 

To validate the method 4 vowels are analysed spoi^sn by a female and a male. The 
vowels are "i:" as In "heed", "ae:" as in "had", "a;" as in "hod", and "u:* as ln Avho*d". 




Fig. 6. 1:", "ss:", "af . "uf. as in "heed", "had", "hod", 
"who'd". 



In phonetics thes« voweis are regarded as cornerstones in the map of vowsls. On .Ig. 
6 [Thorsen 1978] shows the average placement of the first forrrsant F1 and the 
second formant f=^ of 4 voweis pronounced by males, females, and children. As it 
ss seen there Is a fairly big displacement between males, femaies, and children. This 
dispsacement is another prtjbiem in speech recognition. 

In this analysis the above-mentioned 6 band-pass filters define the auditory channels. 
I he first 3 will detect deep vowels and last 3 vs?iii detect high vowels. The deep 
vowels are detected as the rise time from zero to the top of the ripple, which Is about 
a quarter of a period, while the high vowels a.'-e detected as the period from one top 
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io the next. To get a homogeneous picture of the time bins for the deep and high 
vowels, the rise time of the deep voweis is multipfied by 4 and called the period of \hs 
bsap vowel 




"f • 3s in "heed", fema?© 




«0hafinet2 
aOfanri&' 3 



Fig. 7. I: as in heed, pronounced by a male and a 
female. 

Th>3 minimum and maximum bound of the bank of bins are In this anaiysis dhosen to 
lu: and 5 msec. The number of bins is seiecfed to 20 and the width the lime bins is 
ioganthmiG. The tims frame of the anaiysis is selected to 30 msec. In the frame ail 
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ripple periods are measured and sorted according to the channel and time bin. For 
each channel snd time bin all the magnitudes of ths ripples that are detected are 
accii.Tiiiiated. The accurr^ulaled magnitudes are normalized to the maximum 
accumuiated magnitude for each anai^^is and just called the magnitude. 



"8e;"as5R "had", maie 




"m" a$ 5o "had", famais 




Fig. S, ss: as in had, pronounced by a m&ie and a 
femaie. 

Fig. 7 shows the result of the analysis oft:" as in "heed' pmnounced by a male and a 
female, in both cases the maxfmum magnitude is found in chanf^el 5, bin 3. That 
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means that th8 maximum magnitude is found in the frequency band 2000-4000 Hz 
and with a rippis period bstween 0,276 and 0.381 msec. 



Fig. 8 shows the result of the analysis of "ss:" as in "had" pronounced by a male and 
a femaie, in tX)th cases ihe maxirnum magnitude is found in channef 4, bin 6. That 
means that the rnaximum magnitude is found in tje frequency ban6 1400-2800 Hz 
and vm a ripple period between 0.447 and 0.525 msec. 




"a:" as irs "hod". Inmate 




Fig. 9. a: as In hod pronounced by a male and a 
female. 
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Fig, 9 shows the result of the analysis of "a:" ss in "hod" pronounced by a mate snd a 
female. In both cases tlie i-nsximum magnlude iS found In channel 3, bin 12. That 
msans that the maximum magnitude Is found in the frequency band 450-1360 Hz 
and with a nppie period between 1.175 and 1.380 msec. 



"u;" as tn "who'd", maJe 




"u:" as 5st "who'd", female 




Fig. 10. u: as in who'd pronounced by a male and a 
female. 
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Fig. 10 shows m resutt of th& analysis of "u:" as in "who'd" pronounced by a male 
and a fsmaie. In both cases the maximum rnagnitude is found in channel 1, bin 19, 
That mesas that the maximum magnitude is found in the frequency band 150-450 Hz 
and with a ripple period beKveen 3.624 and 4.257 msec. 

The rippls analysis of fne 4 vowels spoken by a male and a female, stsows clearly 
that rippfa period refieet the vowel indepsndent of 8w pitch. The pHch of voice of the 
femais \.vas about twice the pitctj of the voce of male without any fnfiuence on the 

rippie snsiysis. 

The ripple analysis of vowels is extremely noise insensitive. Fig 1 1 shows the rippie 
analysis of "u:" pronounced by the female as shown on fig. 10 but added -5 dB noise 
from 8 car. Cksmpared to fig. 10 there is oniy very liUie difference. 



"u:" as In "who'd", femaia, -5diB car noise added 




Fig. 1 1 > li: as in who'd pronounced by a femaie added ~ 
5 da care nolss. 



In appendix A the rippie periods of some Danish voweis (high yowais)are iisted. in 
the above analysis the rasokitioh of time bins Is 17.5%. but as it is seen from the 
appendix it has at feast has to better than 10% and properly as good 3-5%. 



SynamN: Energy Analysis 

Dynamic energy anaiysis (some times also called envelops or transient analysis) is 
an analysis where the dynamic instantaneous energy Is analysed in the auditory 
channsis. Tiie mathod might be based on a half- or fuii-wave rectification followed by 
a low-pass IlitrBtion, In general the more abrupt the puiss is; the more "sharp" the 
sound picture will be. Fig, 1 2 shows the dynamic energy of the vows! "as;" 
pronounced by a male. By nature the most abrupt changes wiii be present In ^he high 
frequency range. 
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The soms of the ^ieep voweis have ths problem that under some conditions they are 
not c'etectable In the low frequency range bQtow about 1000 Hz. it might be if people 
are laMng through a phone or under spedat nclse cfrcumstancss. Under these 
circumstances these deep vowels are r^resented in the high frequency range as 
dynamic energy Budualions. 




Ffg. 12. Dynamic energy of one puise of the vowei "se:" 



This modulated presentation seems to be best repressnted by the derlvalive of the 
dynamic energy. Fig. 13 shows the denvate of the dynamic energy of the voivel "u;* 
high-pass filtered with a cut-off frecjuenoy at 1400 Hi and fig, 14 shows the derlvate 
of the dynamic energy of the vowe! "a;" aiso high-passed filtered at 1^0 Hz. 

What criteria that have to be met to decide when a ripple or a dynamic (derlvate of 
the dyrsamic energy) analysis is vglid in the high frequency r^nge have not been 
studied In details yet. in the case of dynamic ana^ysis one thsik is however dearly; 
the period of the dynamic fluctuation has to be in a given interval. Other factors are 
that in some cases the ripple periods have a certain scatter and therefore not 
perceived as high yowsj, and in other cases the ripple period is longer than the 
periods valid for high vowels. 
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Fig. 13. "Hie deflvaie of the dynamic energy of oils 
pulse of the vowel "u;" high-pass Sitered at 
1400 Hz. 



Fjg. 1 4. The denvate of {he dynamic energy of one 
pulse of tie vowei "a:" high-pass Sitered at 
1400 H2. 
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APPA Model 



I Rippis Ansiysef 



DyosmicAnatyser 



The model Is based on the assumption that the cachiea is very broaa-banded whan it 
h reiaxed and acts like adapUvs filters if it is actuated by sinusoids and gets more 
nar«5V;i-banded around ihs frequendes. 

Auditory cnannsl Low is a filler bank containing band-pass fsiters in the range from 
150 to 1500 Hz. It might only contain one filter with pass-isand from about 200 to 

1000 Hz. 

Auditory ChanneJ High is a filter bank containing band-pass fiitere In the rang© from 
1000 to 6000 Hz. it might only contain one fiiter with pass-band from 1 500 to 4000 
Hz. 

The fuii model wBi have an Auditory Channai Uttra High, which is a Iter bani< 
containing band-pass filters in the range 4000 to 20000 Hz. 

The Ripple Anaiyssr Low analyses the ripple period by measuring the time from a 
positive Viopie starts and it has its maximum or it goes to zero again. The ripples are 
sorted after the length of their periods in bins and their magnitudes are acoimulated 
in ths respective bin through a specified frame, 

Tl-^e Ripole Analyser Low analyses the rippie period by measuring the time from a 
posiOve rippis has lis jnsxiiT^um to the ne^sl rippie has its maximum, or It couid be 
measured from a ripple starts to tha next starts. Hie rippies are sorted aftsr the 
isngth of their periods in bins and ^eir magnitudes are accumulated in the respective 
bin through s specified fs^rrse. 



15 



Tm O^amic Analyser low analyses the dynamics by detecting th© dedvate of ihs 
dynamic energy. The magnitude and duration of positive going fiuctuations of iha 
denvate are measured and are sorted after the length of their periods in bins and 
tiieir magnitudes are accumulated in the respeclivB bin througii a speafed frame. 

The Dynamic Anaiyser High analyses the dyn3iriics by deleclirsg trse derivate of the 
dynamic er«rgy. The magnitude and duration of positive going fiuctuations of tiie 
dorivate are measured and are sorted after ti^e lengih of Ihoir penods in bins and 
their magnitudes are accumuiated in tiis respective bin tiiroiigti a specified frame. 
Also the peHod ber*een the pulses {ine pitch) througi^out ti^e frame might bs 
analysed. 

The result of irs& ansiysis mighi bs presented as graphs but it migM also be 
interpreted into more spedRc sound pictures. 



DISCUSSiOR 

It is showri that ttis rippis in auditory channels has unique characteristics for four 
different vowels spoksn by a male and female and characteristics of the rippie seems 
to be very Important for how the ear perceives the colour of the sound or idsntifying 
vowels. The ripple is coursed by transient response of systems, wriich msans that it 
is phenomsnon mat consists of a special time frequency reiation. It might be 
assumed mat the auditory channels of ^e cochlea are very broad-banded w^sen it is 
relaxed or affected by broad-banded transient signals. If tiie cociiiea is affected by a 
steady state signal consisting of one ore more sinusoids it might act like adaptive 
filter and be more narrow-banded around the frequencies. 

The band-pass filters used in this analysis are the first estimate. Standard 
Buttsnvorth filters were chosen to give a rapid illustration of the ability of the 
technique, and there are room for improvement. A big difference between a transient 
response and a steady state response is that in a steady state response oniy 
frequencies of the forced signal are present, A transient response consists as well of 
the frequencies of the forced signal as of the Eigenfrequencies of the system. That 
means that the poles of the tiiters that form the auditory channels wtil affeci the nppie 
of the ouises but It shall be as littie as posaMe. in this analysis Buttenworth filters 
have been use but the bast cholee would most probably be filters with real poles and 
ivith an impuise respofsse that are oitical damped as suggested by Leonhard 
[Leonhard 2002]. Buttmforth filters have poies in the complex plane and some of 
mem are fairly dose to the imaginary axis, and they will irrterfere wi^ the signai and 
in same cases give faiss ripples. 

In this analysis the b-ounds for the iow frequency range have been chosen to 150 Hz 
lor the lower and 1 350 Hz the upper boun6, and for the high frequency range to 14G0 
Hz for the lower and 56CG Hz for the upper bound. Studies of a lot of different vowels 
irsdicates that s choice might be 200-300 Hz for the lower bound and 1 30Q-1 400 Hz 
tor the upper bound in the low range, and 1300-1400 Hz for the lower bound and 
3500-4000 Hz for the upper bound in the higii range. Further it seems that if the 
iieriod be&,veen ripoies is longer than about 0,7 msec the rippie time frons the 
slari to the top of the rippie that is important, is the period sho.ner than 0.7 msec then 
it is the period that is important. How maiy channels, the bandwidth of the fiiters and 
their placement has to ba further investigated by evalua^ng tests witi-t different set of 
fiiters and their affect on the ripple, Especiaiiy in the Interval between the low and 
h\Qh range the selection of filters are critical. 
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The time bounds sn this analysis have been chosen to the fetal interval from 0.2 to 
5.0 msec divided mto 20 bins. The interval between the bounds for each bin of the 20 
bins is calculated to be IcgarithmiC. To make A easier to compare the ripple time 
baiwesn the deep and high vowsis ths rippie time of the deep vowels is multiplied by 
4. The time where the npple starts to the top can be viewed as a quarter of a period 
and then it is ccsfiparabie to the rjppie period of the high vowels. 

The time resolution of different bins is 17.5% with the chosen figures as mentioned 
above. As it is seen of appendix A snowing some Danish high vowels this resolution 
is too coarse for the high vowais, it has at leased to be better than 10% and properly 
around 2-3%. On the other hand the total !nten,'3l can be divided Into subsections. 
The total interval for the high vowels might only be about from 0.25 to 0.8 msec. The 
total Interval of ir^terest for t\e deep vowels from the start to the top is around from 
0,2 to 1,1 msec, but it does not iook like that the requirefnent to the time resoiutjon is 
as high as for Uie high voweis, 

it is not possible to give more details of the ftgures for the representaiioa of the 
dynamic energy fluctuation of deep vowels before a hi^er time resolution has been 
smpismented. it wliS also be preferable that ciiticai damped fitters with real potes are 
Implemented for ^ auditory ohanr^els. 



.Applications 

APPA is of catiss very applicable for speech analysis. Even voweis that are 
whispered can be identified. It will also t>e applicable for establishing fr^ethods for 
analysing the intelligibility of speech, as well as methods for analysing sharpness and 
roughness of a sound piaure, and the pitch of speech or music APPA v,?iii also be 
able to lead to sji^aker independent and much more robust speedi recogniiion and 
n^ore effscleM speech compreasiofi with higher qua% \n narrowband 
telecommunication than known today. 

Other applications areas are analysis of all kind of mechanical faults in moving 
machingsy. It misht be defects of ball bearings or of gear wheels in a gearbox. /Uso 
supervising mechanicai establish or in general processes where the sound picture 
reveals quality or faults. It nmght be cutting In wood or metal, of it might be defining a 
specific sound picture of a product as Sie sound of a motortsike or the sound of a car 
door slamming, 

APPA will also be applicaS^e for measuring the quality of audio devices of all kind 
and set up standards for the quality. 

In the medical world there are cases the shape of never pulses have interest and 
APPA will be able to add very important information to the diagnoses of illnass of 
nerve systems. Mso analysis of heart beets and sounds from iungs wilt bring 
important information for medical diagnosis. 
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Appendix A 
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ApproxiiT-ated ripple periods for some Danish nigh vowels: 

-1% hive Q.3Q frtsec. 

V: hele ■ 0.34 msec, 

"arf, h^te 0.38 msec 

y, hyie 0.43 >nsec. 

"a", haie 0,48 msec. 

hms 0.56 msec< 
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